Summary of Ceph practice: CephFS client configuration, cephcephfsBecause CephFS is not very stable at present, it may be used in more experiments.
Before proceeding to this chapter, you need to complete the basic cluster building, please refer to the http://blog.csdn.net/eric_sunah/article/details/40862215
You can attach a file system to a VM or on an independent physical machine. do not perform the followi
create PV and PVC again. Mount it directly in the deployment, as follows:apiVersion: extensions/v1beta1kind: Deploymentmetadata: name: testspec: replicas: 1 template: metadata: labels: app: test spec: containers: - name: test image: dk-reg.op.douyuyuba.com/op-base/openresty:1.9.15 ports: - containerPort: 80 volumeMounts: - mountPath: "/data" name: data volumes: - name: data
Ceph environment setup (2)1. There are three layout hosts: node1, node2, and node3. Each host has three osdks, as shown in figure. osd1, and 8 are SSD disks, 4 is the SATA disk. Each of the three hosts has a Monitor and an MDS. We use osd1, 3, and 4 to create a pool named ssd, in the form of three copies, osd0, and 2, 4 to build a Pool named sata, in the form of Erasure code, k = 2, m = 1, that is, use two osdks to store data fragments, one osd to store verification information, and one osd6, 7,
= admin, secret = AQDFWMBVuwkXARAA/O8kdBTVoCuterXiRMtmrg =Create a cephfs, ceph fs new cephfs hadoop1 hadoop2Rados-p poolname ls can be used to view the objects. Rados-p hadoop2 stat 0000000000d. 00000b2a allows you to view the object information.Create pool: ceph osd pool create hadoop1 1320 1320 view pool list: ceph osd pool ls set pool size ceph osd pool set hadoop1 size 3Ceph osd tree View osd list inf
), Openstackcinder distributed storage (such as Glusterfs, CEPHRBD and CEPHFS) and cloud storage (e.g. Awselasticblockstore or gcepersistentdisk). A common puzzle is "which kind of storage should I choose?" "Different storage backend has different characteristics and there is no storage for all scenarios. Users should choose the storage that meets their needs based on the requirements of the current container application. 1.hostpathhostpath type stora
automatic scaling, recovery, and self-management of clusters because they use the following bindings (at different levels) to provide interaction with your Ceph cluster:
The reliable autonomic distributed object Store (Rados) gateway is a RESTful interface that your application can communicate with in order to store objects directly in the cluster.
The Librados library is a convenient way to access Rados, which supports PHP, Ruby, Java, Python, and C + + programming languages.
The Ceph Rados
Install TFTP server in CentOS 7
I. Introduction
TFTP (Trivial File Transfer Protocol, simple File Transfer Protocol )), it is a Protocol implemented based on UDP port 69 for simple file transmission between the client and the server to provide file transmission services that are not complex, costly, and complex. The TFTP protocol is designed for small file transfer. files can only be obtained from the server or written to the server. directories cannot be listed or authenticated.
The TFTP server
Architecture
1. Ceph Monitor (Mon): Mon node maintains mapping information for each build, including OSD Map, Mon map, PG map, and Cush map, all nodes want to MON report status information.
2. Ceph storage Device (OSD): The only component in a ceph cluster that can store user data. An OSD daemon bundles a partition or hard disk on the system.
3, RADOS (Reliable autonomic distributed Object Store): RADOS is the foundation of Ceph. All the data in Ceph is eventually stored as object
Official documents:http://docs.ceph.com/docs/master/cephfs/http://docs.ceph.com/docs/master/cephfs/createfs/(create CEPHFS file system)Ceph official Chinese Documentation:http://docs.ceph.org.cn/Configuration in OpenStack:http://docs.ceph.com/docs/master/rbd/rbd-openstack/Blogs, etc.:http://blog.csdn.net/dapao123456789/article/category/2197933Http://docs.openfans
typecan be accessed concurrently by multiple instancesShare Access Rule ( ACL )define which clients can access Shareaccording to IP address is definedShare Network (shared network)Define Client Access Share used by Neutron the network and subnetsa Share can only belong to one Share NetworkSecurity Service (security services)User security Services ( LDAP , Active Directory , Kerberos , etc.)a Share can be associated with a maximum of one security serviceSnapshots (snapshot)Share a read-only copy
Principle3.2.1 Pg->osd Principle3.2.1 The relationship between PG and pool3.3 Crush principle Verification (new pool, upload object, figure out Rados, object and Pool, PG, OSD mapping Relationship)The fourth chapter: the Graphical management of Ceph4.1 Calamari Introduction4.2 Calamari Quick Installation4.2 Calamari Basic OperationFifth: Performance and testing of Ceph5.1 Requirement model and design5.2 Hardware Selection5.3 Performance Tuning5.3.1 Hardware level5.3.2 Operating System5.3.3 Netw
implemented partitioning and configured the file system. Run the following command to generate your OSD:$ sudo docker exec Then run your container:Docker Run-v/osds/1:/var/lib/ceph/osd/ceph-1-v/osds/2:/var/lib/ceph/osd/ceph-2$ sudo docker run-d--net=host \-v/etc/ceph:/etc/ceph \-v/var/lib/ceph/:/var/lib/ceph \-V/OSDS/1:/VAR/LIB/CEPH/OSD/CEPH-1 \Ceph-daemon osd_disk_directoryThe following options can be configured:Osd_device i is an OSD device, for example:/dev/sdbOsd_journal used to store the O
/shmnone 1000100 0%/run/user/dev/sdb 163741067153087% /data192.168.239.161,192.168.239.162,192.168.239.163:/ 49120320845912 7%/mnt/cephfs the above shown The available space is certainly wrong, according to Ceph three principle, the real usable space should be less than 15GB, the following method to write 16GB files to verify. 3. DD Write file Mount the file system to/MNT/CEPHFS, generate 8 dd files
I. OverviewCephfs is a CEpH cluster-based file system that is compatible with POSIX standards.When creating a cephfs file system, you must add the MDS service to the CEpH cluster. This service processes the metadata part in the POSIX file system, and the actual data part is processed by the osds in the CEpH cluster.Cephfs supports loading by using INCORE modules and fuse. Both the kernel mode and fuse mode call the libcephfs library to load the
short, crush also uses hashing to calculate the location, but it takes more advantage of the structure information of the cluster. Here's an example to try to understand.The previous three usage scenarios of RBD, CEPHFS and RGW are based on the Rados layer. The Rados layer provides a librados interface, whereby it can implement its own tools. Ceph provides a program Rados by default and can upload an object directly to the Ceph cluster via Rados.
Install and Configure NFS servers in Ubuntu
As the lab project needs to establish NFS on CephFS, record the installation and configuration process of the NFS server in the Ubuntu environment.
1. Introduction to the NFS service:NFS is short for Network File System. It is a distributed File System protocol developed by Sun 1984. Its core function is to allow different clients to access the common file system through the network to share files. For examp
the VM, through the Container and the VM decoupling, so that the block device can be bound to the non-pass VM2. Provide a block device for the host.Both of these methods are to store a virtual block device Shard in the Rados, will use data stripe to improve data parallel transmission, both support the snapshot of the block device. COW (Copy-on-write) cloning. The most important thing is that RBD also supports live migration.Class Fourth: CEPHFS (ceph
: 6789/0}, election epoch 4, quorum ceph0, ceph1Mdsmap e5: 1/1/1 up {0 = ceph0 = up: active}, 1 up: standbyOsdmap e13: 3 osds: 3 up, 3 inPgmap v6312: 192 pgs, 3 pools, 1075 MB data, 512 objects21671 MB used, 32082 MB/53754 MB avail192 active + cleanIV. Mount problems:CentOS7 of client0 does not enable the ceph_fs kernel by default. You need to change the kernel. Here, update the kernel directly using yum (which can be compiled manually ):Yum -- enablerepo = elrepo-kernel install kernel-mlGrub2-s
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.